Uniform Synthesis of Sequential Circuitst 

By J. D. ULLMAN and PETER WEINERJ 

(Manuscript received July 19, 1968) 

In this paper we consider the synthesis of sequential machines by 
networks of a fixed module with delay. We show that every binary in- 
put n state sequential machine has an isomorphic realization using at 
most p copies of a module with 2r + 1 inputs, where p is the smaller of 

— — — ( n 1+logr2 + 4n 1+,OBr4 ) and r2 ln/rl . ([x] is the smallest integer £ x.) 

I. INTRODUCTION 

The realization of an arbitrary binary output synchronous se- 
quential machine by a network of copies of a fixed sequential machine 
(module) or copies of a small number of machines is a problem which 
has received recent attention. 1-5 An equivalent problem has been stud- 
ied in Ref. 6. A design of this sort is particularly suited to batch fabri- 
cation techniques, because it is possible to mass produce a fairly 
complex integrated circuit (the module) and then wire these circuits 
together to realize any desired sequential machine. 

The machines, so constructed, will be fast; the time between inputs 
need not be longer than the time it takes a single module to resolve 
its output after a change in input, no matter how many modules are 
in the network. The disadvantage of this technique, so far, has been 
the large number of copies of the module necessary to realize a 
machine; as many as 2" — 2 copies for an n state machine are re- 
quired when using the modules of Refs. 1 and 2. These modules are 
shown in Fig. 1 for the binary input case. 

Not shown in any of our diagrams is provision for initializing the 
output of any module to the hot (1) state if desired. Neither is pro- 
vision for control of the module by a clock shown in this or any other 
module. 



t Portions of this paper appeared in the Proceedings of the IEEE 9th Annual 
Symposium on Switching and Automata Theory, Schenectady, N. Y., October 
1968. 

t Princeton University, Princeton, New Jersey. 
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Fig. 1 — Simple modules. 



The modules of Fig. 1 each have two intermodule inputs, that is, 
inputs to which either logical constants or the output of some module 
will be connected. If a module with two intermodule inputs is uni- 
versal (can realize any sequential machine having one binary input), 
then there is a unique minimal network composed of copies of this 
module realizing a particular sequential machine with a binary 
input. 1,2 If there are more than two intermodule inputs, there may be 
more than one network realizing a given machine. We consider a class 
of modules with different numbers of intermodule inputs and attempt 
to design small networks consisting of copies of one of the modules 
in the class. 

The class of modules we use for single input machines is represented 
schematically in Fig. 2a. There is a member of the class with 2r inter- 
module leads for each r ^ 1. Let the module of Fig. 2a with a partic- 
ular value of r be M T . Note that M t is essentially the same as the 
module of Fig. la. M 2 is shown in Fig. 2b. 

In what follows, we restrict ourselves to the design of networks for 
the realization of machines with one binary input. The generalization 
to the use of machines having k binary inputs is straightforward when 
one uses a class of modules represented schematically in Fig. 3. 

Notice that conventional designs of sequential circuits, represented 
schematically in Fig. 4, require the construction of log 2 n Boolean 
functions of k + log 2 n variables, where k and n are the number of 
input variables and states, respectively, of the machine. The number 
of gates necessary for a two-level realization of several functions of p 
variables can be as high as 2", so one would expect, even in the case 
k = 1, to require as many as n gates for a realization in the form of 
Fig. 4. We cannot show, for fixed r, that all n state machines with 
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Fig, 2 — (a) The module M r ; (b) the module Ma. 

single inputs can be realized by networks of as few as n copies of M r . 
However, we show that the number of copies of M r needed to realize 
any binary input n state sequential machine is bounded above by two 
functions of n. These functions, to within a constant factor, are 2 n ' 

1 l + locr' 1 

and n '"" . 
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Fig. 4 — Conventional sequential circuit. 



II. DEFINITIONS AND BASIC CONCEPTS 

A sequential machine will be denoted A = (K, 2, 8, q , F). K and 2 
are finite sets of states and inputs, respectively. F, the final states, is a 
subset of K. It is the set of states for which the output is 1. go, the 
start state is a particular element of K. 8 maps K X 2 to K. It gives 
the next state for each combination of state and input symbol. The 
function 8 is usually displayed as a flow table, with a row for each 
state and a column for each input. The entry in the ith row and jth 
column is the value of 8 for the ith state and ;th input. The first state 
will always be the start state. An example is shown in Table I. 

We extend 8 to domain K X 2* by:f 

(0 8 (q, e) = q for all q in K. 

(ii) 8(q, wa) = 8 (8 (q, w), a), for all q in K, w in 2*, and a in 2. 

The event defined by the machine A, denoted T(A), is {w | 8 (q , w) 
is in F}. That is, T(A) consists of exactly those input strings which 
cause A to go from the start state to a final state. For example, if 3 
and 5 are the final states of the machine of Table I, then 110 is in 
T{A), since 8(1, 1) = 6, 8(6, 1) = 4 and 8(4, 0) = 5. 001 is not in 
T(A) since 8(1, 0) = 3, 8(3, 0) = 1 and 8(1, 1) = 6. 

Let R be a subset of 2* for some finite set 2. For each w in 2*, 
define the derivative of R with respect to w, denoted R/w to be set 
of strings x such that xw is in R.% 



t 2* is the set of all strings of symbols in S, including e, the string of length 0. 
X This notion of derivative is "backwards" from that used in Ref. 7. It is 
actually the quotient operation of Ref. 8. 
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Let A = (K, 5, 8, q , F) be a machine, and let 2 = {0,1}. We can 
define two "inverses" of 8, denoted /*<, and m. These functions map 
sets of states to sets of states by : 

*>(G) = Iff I % 0)isinG}, 
Mi(G) - (el 5(5, 1) is in G}. 

For each subset G of K, let 4 be the machine {K, {0, 1}, 8, go, G). 
Let H = ixo(G) and J = /n((?). If B = ^Uo), then 22/0 = T(A„) 
and R/l = T(Aj). For w is in B/0 if and only if wO is in T(A ). 
But u0 is in T{A a ) if and only if S(g , w) is a state p such that 
8(p, 0) is in G. Equivalent^, w is in R/0 if and only if 8(g , w) is in 
H. The argument for R/l is analogous. 

When talking about a fixed sequential machine, A — {K, {0, 1}, 8, 
g , F), we often identify T(A G ) with G for each subset G of K. We 
use G/0 and G/l for ^(G) and ^(G). For example, if A is the 
machine of Table I and G = (1, 3, 5}, then G/0 = {1, 2, 3, 4, 5} and 

G/1 = {3} - • , ». 

A network of a module M is an interconnection of copies of M 

such that each intermodule input is connected to either the output 

of a copy of M in the network or a logical constant (0 or 1). The 

external inputs of each copy of M (or corresponding external inputs 

if a copy has more than one) are connected together and receive the 

input to the network. One copy of M is designated the output of the 

network; the network accepts an input sequence if the output of the 

designated copy is hot (1) after receiving the sequence. 

The module M 2 of Fig. 2b is repeated as Fig. 5 with certain points 

marked. Suppose that this module is part of a network realizing the 

event F of the sequential machine A = (K, {0, 1}, 5, q , F). Suppose 

also, that it has been determined that the output of this copy of the 

module must be some event G C K. That is, the output of this module 
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Fig. 5 — Points in the module M% . 



is hot exactly when the sequence of inputs to the network is in the 
event G. Thus, when the last input appears at the external input of 
this module, point a, the input to the delay, must immediately become 
hot if and only if the last input completes a sequence in G. 

Observe that point b can be hot only if the last input is 1 and point 
c can be hot only if the last input is 0. Thus, immediately before the 
last input appears at the external input terminal, point d must be hot 
if and only if the previous inputs form a sequence in G/l and point e 
must be hot if anly only if the previous input sequence is in G/0. 

The union of the events at / and g must thus be G/l and the union 
of events at h and i must be G/0. We are free to choose the events at 
the intermodule inputs subject only to these constraints. For ex- 
ample, we could choose the events at / and g to be those strings in G/l 
of even and odd length, respectively. However, we restrict our choice 
so that the events at the intermodule leads will be representable as 
sets of states of A. 

Design, using the module M r , r > 2, proceeds the same way. If a 
given copy of the module is to realize the event G, then the lowest r of 
the intermodule inputs must be from modules realizing events Hi, H 2 , 
■ • • , H r whose union is G/l ; the remaining r intermodule inputs must 
be from modules realizing events Ji, Jo, '" , Jr, whose union is G/0. 
However, some of Hi, • • • , H r or J±, • • • , J r may be the empty set 
or the set of all states, in which case these events are "realized" by 
logical constants rather than modules. 

The above arguments justify the following reduction in the design 
problem for the class of modules M r , r ^ 1: 

Let A = (K, {0, 1}, 8, q , F) be a sequential machine. An Mr-syn- 
thesis of A is a set S of subsets of K having the properties: 

(0 F is in S. 

(u) If G is in S, then there are sets #, , H 2 , • • • , H T and 
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,/.,«/ a , • • • , J T in S, not necessarily all distinct, such that 
\JH { = G/1 and \Jj T = G/0. 

From what we have said concerning the flow of signals in the 
module M r , we may conclude that if S is an M r -synthesis of A, then 
there is a network of m copies of M r realizing T(A), where m is the 
number of elements of S that are neither $ nor K* We call m the 
size of S. 

Notice that an M r -synthesis requires that all modules realize events 
which are identifiable with a set of states. Such networks are called 
isomorphic to A. There may be networks of copies of M r which realize 
T(A), but are not M r -syntheses of A. However, in our search for small 
networks we shall not consider any networks except- those which are 
M r -syntheses. See Ref. 5 for some comments on the existence of non- 
isomorphic realizations of sequential machines. 

III. CONSTRUCTION OF ilf r -SYNTHESES 

The purpose of this paper is to show that M r -syntheses of small 
size exist for an arbitrary n-state sequential machine. The first bound 
on the size of an M",-synthesis is straightforward. 

Let A = (K, {0, 1}, 5, q , F) be an n state sequential machine. We 
may choose r disjoint subsets of K, say K x , K 2 , • • • , K r , such that 
\JUi K< = K and no K { ,1 ^ i ^ r, contains more than [n/r] states. J 
Let S = [F} VJ {0 | G C Kt for some i). To see that S is an M r -syn- 
thesis of A, we have merely to observe that any subset G of K can be 
expressed as Ui-i G < i where G t = G C\ K t Q K< for all i. Thus, for 
any H in S, H/0 and H/l are both the union of r elements of S. 

The size of S is no greater than 1 + r (2 In/rl - 1), which is almost 
r2 fB/r '. We thus have: 

Theorem 1 : If A is an n state sequential machine, with a single binary 
input, then there is an M T -synthesis of A using at most r2 [n/r] copies 
of M r . 

Notice that Theorem 1 is not dependent upon the assumption that A 
has a single binary input. The machine A in that theorem can have 
any number of binary inputs. Of course, the appropriate generaliza- 
tion of the input module M r , as given in Figure 3, must be used. 



t * denotes the empty set. 

% We use [x] for "the smallest integer equal to or greater than x." 
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Example: We use a technique suggested by Theorem 1 to design a net- 
work for the sequential machine of Table I with final states (4, 5, 6}. 
We generate subsets in a sequential manner, and terminate when no 
new sets are required. Let r — 2 and let the states be divided into two 
sets Kt {1, 3, 5} and K 2 = {2, 4, 6}. Now {4, 5, 6}/0 = {2, 4, 5} and 
{4, 5, 6}/l = {1, 2, 3, 4, 6). If we intersect {2, 4, 5} and {1, 2, 3, 4, 6} 
each with K x and JC 2 , the inputs to the module realizing {4, 5, 6} must 
be connected to modules realizing {5}, {2, 4}, {2, 4, 6} and {1, 3}. 
The two derivatives of each of these sets are found among {2, 4, 5}, {6}, 
{1, 3}, {3}, {2, 5, 6}, {1, 2, 4, 5, 6} and <J>. Intersecting each of these 
sets with Ki and K 2 , we find that the network needs modules realizing 
the events {6}, {3}, {2, 6} and {1, 5}, in addition to the modules 
already used. Proceeding in this way, we find that the entire network 
also requires modules realizing {1}, {4} and {3, 5}. The completed net- 
work is shown in Fig. 6. Modules are labeled with the event (set of 
states) they realize. Those modules realizing a set including state 1, 
the start state, must initially give a 1 output. Inputs to the module 
are shown in no particular order, and inputs not shown are connected 
toO. 

The second bound uses the concept of partitions on the set of states 
of a finite automaton. A partition on a set of states K is a set of 
disjoint, nonempty sets, called blocks whose union is K. If A = 
(K, {0, 1}, 8, g^, F) is a sequential machine, we can associate with 
eveiy string w in {0, 1}* a partition n 10 as follows: 

(i) Tie = ({?!}, {q 2 }, ••• , {?,„}), where K = {q lt q 2i ••■ , q„,).j 
(ii) For any w in {0, 1}*, let n w be (K lf K 2 , ••• , K r ). Let 
IL^ be the list of nonempty sets G such that G = K t /0 for some i and 
IT tol be the list of nonempty sets H such that H = Ki/1 for some i. 
Example: Consider the machine of Table I. n e = 1, 2, 3, 4, 5, 6) 
IT is the list of sets of states that map to a single state under a 
input. Thus, n = (1, 245, 3, 6). Similarly, III = (14, 26, 3, 5). Pro- 
ceeding, we can calculate Ilooand n i from IIo by seeing which sets 
of states map onto a single block of n under inputs and 1 , respec- 
tively. For example, states 2, 4, 5 and 6 are those which map under a 
input to one of the states 2, 4 or 5. We find n 00 = (1, 2456, 3) and 
IIo! = (14, 2356). Also, n 10 = (1, 245, 3, 6) and n n = (145, 26, 3). 

A partition LT is said to represent a family of sets, namely those sets 



f We denote partitions by lists of the blocks. Sometimes it is simpler to repre- 
sent each block by, a string of states not surrounded by brackets. Thus (,{qi, q a ), 
{qa}) will appear as (q^qs, qs). 
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Fig. 6 — Network suggested by Theorem 1. 

which are the union of some of the blocks of II. For example, Hoi above 
represents the sets $, {1, 4}, {2, 3, 5, 6} and {1, 2, 3, 4, 5, 6}. Suppose 
n„ — (K x , K* , • • • , K m ) and G is the union of j of K t , K 2 , • • • , K„ , 
say G = K il W K it U • • • \J K if . Then for a = or 1, 

G/a = K.-./a W £<./a U • • • VJ 2£ <t /a is represented by n„ a and is, 
in fact, the union of, at most, j blocks of n„ a . Armed with this obser- 
vation, we prove: 

Theorem 2: For every n state sequential machine with single binary input 
A = (K, {0, 1}, 8, q , F) and r ^ 2, there is an M t -synthesis of A of 

size at most , , 

2r — 1 

Proof: Let j = [log r n]. Define the blocks of those partitions n„ , such 
that | w | ^ ;t to be basic events. We will choose 3 to be a set of pairs 
(G, w), where G C K, w is in {0, 1 }*, and for each (G, w) in 3, (7 is re- 
presented by n„ . After constructing 3, we construct S, an M ..-synthesis 
of A, from 3 by S = {$} U {G | (G, if) is in 3 for some w}. We con- 
struct 3 by: 

(i) (F, e is in 3). 

(ii) If G is a basic event, then (G, e) is in 3. 

(Hi) Let (G, w) be in 3, | w \ < j, and let G be the union of k blocks 
of n„, . We may choose H x , H 2 , • • • , H r such that their union is G/0 



-(n 1+,0Br2 + 4n 1+,og ' 4 )- 



t \w\ denotes the length of w. 
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and for each i, H { is the union of from zero to [k/r] blocks of LT^o • Also, 
choose J i , J 2 , • • • , J r such that their union is G/l and for each i, J t 
is the union of from zero to [k/r] blocks of n„,i . If H { is not $ or a basic 
event, add (H { , u>Q) to 3. If </, is not <S> or a basic event, add («/,• , wl) 
to 3. 

We say that each (H { , wO) or (J t , wl) in 3 is in the family of (G, w). 
We extend the notion of a family by saying that (G, w) is in its own 
family and if (H, x) is in the family of (G, w) and (J, y) is in the family 
of (H, x), then (J, y) is in the family of (G, w). The family of (G, e), 
where G is F or a basic event, can be thought of as the set of elements 
that must be in 3 because (G, e) is in 3. 

We must show that S is an ilf ..-synthesis of A. If (G, xo) is in 3, then 
G consists of at most ?*' _|u ' 1 blocks of n„, . (Since r' ^ n, we have r' _1 = 
[r'/r] ^ [n/r]; r'~ 2 = \r , ~ l /r] ^ [[w/?']/ ? j and soon.) We may conclude 
that if | w | = j, then G would be a basic event, and hence, for no G and 
w of length j is (G, w) in 3. If G is a basic event or F, one can, by rule 
(iii) find Hi , H 2 , • • • , H r and J, , J 2 , • • • , J T such that 

G/0 = \jH t , G/l = [JJi • 

For all i, either (H , , 0) is in 3 or H { = $ or H { is a basic event, and 
either (J,- , 1) is in 3 or J t = 3> or J",- is a basic event. In any case, all of 
H i , H 2 , ■ • - , H r and J t , J 2 , • • • , J T are in S. If G is in S but G is 
neither a basic event not F, then it must be that (G, w) is in 
3 and | w \ < j. But in this case, it again follows immediately from rule 
(iii) that H t , H 2 , • • • , H r and J x , J 2 , • • • , J r in S can be found with 
UJ-, Hi = G/0 and ^-> J< = G/l. 

We must now put a bound on the size of S. We do so by bounding 
the number of elements in the families of all (G, e) in 3. The sum of the 
sizes of all these families bounds the size of S. 

Suppose G consists of k states and m = [log r /c]. For each i ^ 0, there 
are at most (2r)' elements (H, w) in the family of (G, e) such that \w\ = i. 
If (H, w) is in the family of (G, e), then H consists of at most r m ~ 1 "' 1 
blocks of U w . Thus the family of (G, e) contains no pair (H, w) such 
that \w\ ^ m. An upper bound on the size of the family of (G, e) is 
1 + 2r + (2?-) 2 + • • • + (2r)*"\ This number does not exceed 
(2r) m /(2r - 1). But m ^ 1 + log r /c, so (2r) m ~ 1 ^ k 1+ioer \ 

We may conclude that the family of (F, e) consists of at most 



2?' „.l + logr2 



elements. We must also bound the families of the basic 



2r - 1 

events, and do so by the following argument. 
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Let N k be the number of basic events consisting of exactly k states. 
There are 1 + 2 + 4 + • • • + 2'' partitions n„ where \w\ ^ j. The 
number of these partitions is at most 2' +1 ; the blocks of each partition 
have among them a total of n states. Thus: 

J2kN k ^n2 i+1 . (1) 

An upper bound on the sum of the sizes of the families of all the basic 
events is 



Since k does not exceed n in the summation, we have 



Using equation (1), we see that the sum of the sizes of the families 
of all basic events is bounded above by 2r/(2r - l)n 1+l08,2 2' +1 . Since 
i ^ 1 + log r n, this bound becomes 8r/(2r - l)w 1+logr4 . 

Including the family of (F, e), we see that the size of S is no greater 

than -^— (n l + l0 *' 2 + 4n , + ,og ' 4 ). 
Zr — 1 

We comment that a straightforward generalization of this argument 

shows that every sequential machine with p binary inputs (2 P symbol 

input alphabet) can be realized by a network of at most 2 v r/(2 p r — 1) • 

( n i+piog,2 _j_ 4 * n i + piogr4) cop i es f the generalization of the module M r . 

Thus, for any number of binary inputs p, and any c > 0, there are 
constants r and k such that any n state sequential machine with p binary 
inputs can be realized by a network of at most kn l+e copies of a module 
with 2 v r intermodule leads. 

Example: Theorem 2 suggests the design of a network of copies of M 2 
for the machine of Table I with states 4, 5 and 6 final. That machine 
has 6 states and [log 2 6] = 3. However, in this case the construction of 
3 given in Theorem 2 will not require the addition of any pair (G, w) 
where \w\ > 1. So we may restrict ourselves to consideration of certain 
sets represented by the partitions n„, , for \w\ ^ 2. These were calcu- 
lated in the previous example: 

n« = (1, 2, 3, 4, 5, 6) n u0 = (1,-2456, 3) 

n = (1, 245, 3, 6) n 01 = (14, 2356) 
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n, = (14, 26, 3, 5) 



H 10 = (1,245,3,6) 
H„ = (145,26,3). 



We begin by placing ({4, 5, 6}, e) in 3. {4, 5, 6}/0 is the basic event 
{2, 4, 5}, and {4, 5, 6}/l is the union of three basic events {2, 6}, {3} 
and {1, 4}. These three must be formed into two groups; we choose to 
realize {2, 3, 6} and {1, 4}. We place ({2, 4, 5}, e) and ({1, 4}, e) in 3, 
since these are basic events, but since {2, 3, 6} is not a basic event, 
we place ({2, 3, 6}, 1) in 3. 

{2,4,5}/0= {2,4,5}U {6}, so ({6}, e) is placed in 3. {2,4,5}/lcan 
be expressed as {2, 3, 6} U {5}. We thus place ({5}, e) in 3. {1, 4}/0 = 
{3} and {1, 4}/l = {2, 6). Each of these are basic events, so ({3}, e) 
and ({2,6}, e) are placed in 3. {2, 3, 6}/0 = {1} U { 6 }. These are basic 
events, so we add ({1}, e) to 3. {2, 3, 6}/l = {1, 4} VJ {5}; these basic 
events are each represented in 3 already. Proceeding, we find that the 
basic events added to 3 require no new events, basic or not. The re- 
sulting network is shown in Fig. 7. 



IV. CONCLUSIONS 

We have considered the design of synchronous sequential machines 
by networks of a fixed module. This design has various advantages, 
including speed and ease of production using batch fabrication. It was 
shown that there is a family of modules M T , r ^ 1, such that any n 
state sequential machine with a single binary input can be realized by 
a network of at most p copies of M T , when p is the minimum of r2 In/rl 
2r ( w i+i.„2 + 4n i + io 8r4 ) 



and 
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Fig. 7 — Network suggested by Theorem 2. 
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We feel that the type of design suggested in this paper leads to 
many interesting questions. In particular, the bounds expressed 
in Theorems 1 and 2 do not seem to be attained, or even approxi- 
mated, in most cases. Efficient search techniques will probably yield 
much better networks than indicated; there is every reason to sus- 
pect that the bounds themselves can be improved, even if we restrict 
consideration to isomorphic networks. 
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